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Abstract 

Background: About 15% of adolescents in the Netherlands have mental health problems and many also have 
health risk behaviours such as excessive alcohol consumption, cigarette smoking, use of drugs, and having unsafe 
sex. Mental health problems and health risk behaviours may have adverse effects on the short and longer term. 
Therefore, in the Netherlands there is a considerable support for an additional public health examination at age 
15-16 years. The study evaluates the effect of two options for such an additional examination. Adolescents in the 
'E-health4Uth' group receive internet-based tailored health messages on their health behaviour and well-being. 
Adolescents in the 'E-health4Uth + counselling' group receive the computer-tailored messages combined with 
personal counselling for adolescents at risk of mental health problems. 

Methods and design: A three-arm cluster randomised controlled trial will be conducted in the Netherlands among 
fourth-grade secondary school students. School classes are the unit of randomisation. Both intervention groups 
complete the computer-tailored program during one class session; the program focuses on nine topics related on 
health behaviour and well-being. For each topic a score is computed that can be compared with the Dutch health 
norms for adolescents. Based on the score, a message is presented that reflects the person's current behaviour or 
well-being, the Dutch health norm, and offers advise to change unhealthy behaviour or to talk to a person they 
trust. Adolescents in the 'E-health4Uth + counselling' group are also invited for an appointment to see the nurse 
when they are at risk of mental health problems. The control group receives 'care as usual'. 
The primary outcome measures are health behaviour (alcohol, drugs, smoking, safe sex) and mental health status. 
The secondary outcome measure is health-related quality of life. Data will be collected with a questionnaire at 
baseline and at 4-months follow-up. A process evaluation will also be conducted. 

Discussion: It is hypothesized that at follow-up adolescents in the 'E-health4Uth' group and adolescents in the 
'E-health4Uth + counselling' group will show fewer mental health problems and less risky behaviour compared to 
the control group. 
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Background 

Problems among adolescents 

About 15% of adolescents in the Netherlands have mental 
health problems [1]. During adolescence, mental health 
problems among girls tend to increase, and young people 
from lower educational levels or from families with a 
lower socioeconomic status report more difficulties than 
young people from better-off families [1,2]. Young persons 
with mental health problems are at risk of adverse mental 
health outcomes later on [3-5]. In general, high levels of 
behavioural and emotional problems at a young age are 
related to the DSM-IV diagnoses in adulthood [6]. 

Health risk behaviours such as excessive alcohol con- 
sumption, cigarette smoking, use of drugs, and having 
unsafe sex are also prevalent among adolescents [1]. The 
Health Behaviour in School- Aged Children: WHO Col- 
laborative Cross-National Study (HBSC) shows that of 
the 16-year-old adolescents in the Netherlands about 
71% drank alcohol during the 30 days preceding the sur- 
vey, 19% smoked daily, 12% used cannabis during the 30 
days preceding the survey, and 20% of the sexually active 
adolescents did not use a condom at last sexual inter- 
course [1]. These health risk behaviours may have ad- 
verse effects on the short and longer term [7]. For 
example, through unsafe sex adolescents can get sexually 
transmitted diseases or become pregnant [1]. Beginning 
at an early age with alcohol use may have adverse psy- 
chological consequences [8] and smoking may negatively 
affect school performance [9]. Moreover, alcohol and 
drugs use are often associated with aggressive and delin- 
quent behaviour [10-12]. 

Early detection and prevention of problems in 
adolescence 

The Netherlands has a well-organised system for mainten- 
ance of the health of children, i.e. the Youth Health Care 
system [13]. All children and adolescents are invited for 
preventive periodic health examinations' at set ages until 
the age of 13 years. These examinations focus on growth, 
development, health functioning, and behaviour of infants, 
children, and adolescents. At age 13 years, the physician 
or nurse interviews the adolescents and provides health 
counselling. If physical of psychosocial problems are 
encountered, the physician or nurse may invite the adoles- 
cent (and parents) for a follow-up visit or may refer them 
to a general practitioner. Participation is voluntary and the 
care is offered free of charge by the government. 



Given the rapid maturation of adolescents, and the 
associated mental health problems and health risk beha- 
viours, there is a considerable support in the Nether- 
lands for an additional examination at age 15-16 years. 
Several options for this examination have been proposed 
by the National Institute for Public Health and Environ- 
ment [14]. One option is that adolescents complete an 
online questionnaire about their health behaviour and 
well-being, and then receive tailored messages about 
their health behaviour and well-being CE-health4Uth'). 
Computer-tailored health education is a good opportu- 
nity to provide health messages regarding individual 
health behaviour and behavioural determinants, because 
tailored messages eliminate (as far as possible) informa- 
tion that is not personally relevant [15-18]. Computer- 
tailored messages are more likely to be effective in 
changing behaviour compared to non-tailored messages 
[16]. A second option, advised by the National Institute 
for Public Health and Environment, is to combine the 
computer tailoring with personal counselling for adoles- 
cents at risk of mental health problems CE-health4Uth + 
counselling') [14]. The online questionnaire used for 
generating the tailored messages can also be used for 
early detection of adolescents at risk of mental health 
problems. Early detection of mental health problems, 
and if necessary tailored counselling or referral for treat- 
ment, may improve the prognosis of adolescents with 
mental health problems [19]. Therefore, it may be bene- 
ficial to combine computer tailoring with personal coun- 
selling for adolescents at risk of mental health problems. 

For both these options ('E-health4Uth' and 'E- 
health4Uth + counselling'), it is possible to use E-health 
modules with internet-based tailored messages, which 
were developed for adolescents (aged 12-18 years) and 
applied in an earlier study [20]. In a process-evaluation 
it was found that the individually-tailored messages were 
appreciated by adolescents. However, the effects of the 
internet-based messages on adolescents' behaviour and 
well-being has not yet been studied [21]. 

Objectives 

The aim of this study is to evaluate the effect of two inter- 
ventions on mental health and health behaviour (alcohol 
and drug use, smoking, safe sex). Adolescents in the inter- 
vention group 'E-health4Uth' receive the computer-tailored 
health education. Adolescents in the intervention group 
'E-health4Uth + counselling' receive computer-tailored 
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health education combined with counselling for adoles- 
cents at risk of mental health problems. Additionally, a 
process evaluation will be conducted to provide insight in 
the feasibility of the two interventions. This article 
describes the design of the study. 

Study hypothesis 

The hypotheses of the study are twofold. First, adoles- 
cents in the 'E-health4Uth' group will show fewer mental 
health problems and less risky behaviour (alcohol and 
drug use, smoking, safe sex) at follow-up compared to 
the control group (care as usual'). Second, adolescents 
in the 'E-health4Uth + counselling' group will show 
fewer mental health problems and less risky behaviour 
(alcohol and drug use, smoking, safe sex) at follow-up 
compared to the control group (care as usual'). 

Methods and design 

Study design 

The study design is a three-armed cluster randomised 
controlled trial (RCT), with a baseline measure point be- 
fore the interventions and a follow-up measure four 
months after start of the interventions. This study is 
conducted in the Netherlands among fourth-grade se- 
condary school students (aged 15-16 years). School 
classes are the unit of randomisation, because random- 
isation at the individual level (i.e. the level of the adoles- 
cents) may lead to contamination of the control group 
[22]. Block randomisation is used as this allows to start 
the study whilst still including schools and classes. The 
randomisation code was developed using a computer 
random number generator in SPSS to select random 
permuted blocks (specified allocation ratio 1:1:1). School 
classes are stratified according to educational level, with 
pre-vocational education in one stratum and higher than 
pre-vocational education in the other stratum. 

The effects of 'E-health4Uth' and 'E-health4Uth + 
counselling' will be evaluated at 4-months follow-up by 
comparing the outcomes on mental health status and 
health behaviour between the adolescents in the two 
intervention groups and in the control group. 

Data collection started in the autumn of 2012 and will 
continue until June 2013. The Medical Ethical Com- 
mittee of Erasmus MC declares that the Medical 
Research Involving Human Subjects Act (also known by 
its Dutch abbreviation WMO) does not apply to this re- 
search proposal. The Medical Ethical Committee has no 
objection against the execution of this research proposal 
(MEC-2012 - 337). 

Procedure 

A few weeks prior to the start of the study, all adoles- 
cents and parents receive information about the study. 



Information letters providing details about the study for 
the students and the parents are handed out at school. If 
parents do not want their child to participate, they can 
object to participation of their child. Adolescents are 
asked for their permission to participate before they 
complete the baseline questionnaire. 

All adolescents receive a singular, personal code to log 
in at one of the three websites of the study. The link of 
the websites depends on the group ('E-health4Uth', 'E- 
health4Uth + counselling', or the control group) to 
which the adolescent is assigned. At the websites the 
adolescents can complete the questionnaires. A trained 
research assistant explains the procedure for the comple- 
tion of the questionnaire at the beginning of the lesson 
and is available to answer questions. During one class 
session (+/- 45 min) adolescents complete the online 
questionnaire. In the two intervention groups the adoles- 
cents also receive the tailored messages during this class 
session. Prior to the start of the study, specialised Youth 
Health Care nurses were informed about the study and 
trained in interviewing adolescents in this age group. 

The participant flow is shown in Figure 1. 

Participants 

Youth Health Care organisations and schools 

This study is carried out in the Dutch cities of Dordrecht 
and Zwijndrecht. Recruitment of schools is organised in 
collaboration with two Youth Health Care organisations. 
The directors of 14 secondary schools in Dordrecht and 
Zwijndrecht have been informed about the study by let- 
ter, invited to participate, and have been contacted by the 
researchers. From the 14 schools, 12 agreed to participate 
in the study with a total of 60 classes of fourth-grade 
students. 

Adolescents 

Per school, all the students in the fourth grade are 
invited to participate. A trained researcher assistant 
briefly explains the purpose and procedure of the study 
in the classroom. 

Intervention 'E-health4Uth' 

Adolescents complete the computer-tailoring program 
during one class session (+/- 45 min). This program fo- 
cuses on nine topics related to health risk behaviour and 
well-being: alcohol consumption, drugs use, smoking, se- 
xual behaviour, bullying, mental health status, suicidal 
thoughts, suicidal attempts and unpleasant sexual expe- 
rience (Table 1). We use internet-based tailored messages 
which were developed for adolescents (aged 12-18 years) 
and applied in an earlier study [21]. The questionnaire used 
for the tailored messages is constructed on the basis of se- 
veral existing instruments which are used by Municipal 
Public Health Services and health institutes (Table 1) [23]. 
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Figure 1 Flow chart of the clusters and participants through the trial. 
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Consensus on the use of these instruments was established 
by the National Institute for Public Health and Environ- 
ment (RIVM), the Dutch association for residential and 
home care organisations and infant and child health 
clinics (Actiz), and the Association of Muncipal Public 
Health Services in the Netherlands (GGD Nederland). 

For each topic, a score is computed that can be com- 
pared with the Dutch health norms for adolescents [21]. 
Based on the score, a message is presented that reflects the 
person s current behaviour or well-being, the Dutch health 
norm, and offers advise to change unhealthy behaviour or 
to talk to a person they trust. By providing links to relevant 
websites, adolescents are encouraged to search for more 
information on the topics. The tailored messages are pre- 
sented on the computer screen immediately after the ques- 
tionnaire has been completed (Figure 2). The messages are 
displayed in red, orange or green, indicating unhealthy 



behaviour, behaviour just below the norm, or behaviour 
according to the Dutch health norm, respectively. The 
topics on well-being are always displayed in blue. At the 
end of the program, adolescents are invited to follow the 
Facebook page of 'E-health4Uth' to find additional infor- 
mation about all the topics. Also, adolescents can check a 
box for a self-referral with the nurse, or can send an e-mail 
to the nurse. After one month the adolescents receive a re- 
minder of the tailored messages. 

Intervention 'E-health4Uth + counselling' 

Adolescents in this group also receive the tailored mes- 
sages, are invited to follow the Facebook page (see 
Intervention 'E-health4Uth'), and can check a box for a 
self-referral with the nurse or send an e-mail to the nurse. 
In this group, adolescents at risk of mental health pro- 
blems are also invited for an appointment to see the nurse 
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Table 1 Topics of the E-health modules 
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Smoking 


How often the adolescent smokes (2 items) 


Sexual behaviour 


How often the adolescent uses condoms 




during sexual intercourse (2 items) 


Bullying 


How often the adolescent is bullied at school, 




somewhere else or on the internet (3 items) 


Mental health status 


Strength and Difficulties Questionnaire (SDQ) 




(25 items) with a total score range 0 - 40 


Suicidal thoughts 


If the adolescent has had suicidal thoughts 




last year (1 item) 


Suicidal attempts 


If the adolescent made a suicidal attempt 




last year (1 item) 


Unpleasant sexual 


If the adolescent has ever had an unpleasant 
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sexual experience (1 item) 



(Table 2). The criteria for an appointment are: those who 
report mental health problems as measured with the 
Strengths and Difficulties Questionnaire (SDQ) (cut-off 
point > 90^^ percentile), those who report emotional pro- 
blems as measured with the SDQ subcale emotional pro- 
blems' (cut-off point > 90^^ percentile), those who report 
having suicidal thoughts occasionally or more often, and 
those who report a suicide attempt last year. The cut-off 
points of > 90^^ percentile are based on a cross-national 
survey among 15-16 year old adolescents. This study 
was carried out by the Health Behaviour in School-Aged 
Children: WHO Collaborative Cross-National Study 
(HBSC) [1]. 

The appointment with the nurse takes place at the 
adolescents school. We expect that about 20% of the 
adolescents will meet the inclusion criteria for an ap- 
pointment with the nurse [24]. The nurses receive the 
results of the assessment for each referred adolescent 
prior to the consultation. During the consultation the 
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Bedankt voor het invullen van de vragenlijsti 

Hieronder kun je jouw persoonlijke gezondheidsprofiel bekijken. 

Per onderwerp wordt per kleur weergegeven: 

■Je bent gezond bezig' (Groen) 

'Er valt iets te verbetaren' ( ■ ■ ) 

'Je gedrag is nadeling voor je gezondheid' (Rood) 

Bij onderwerpen wasr je zelf moeilijk iets aan kunt veranderen, zoals 'pesten', wordt dit altijd weergegeven in de kleur blauw. 

Door een onderwerp aan te klikken, krijg je meer informatie over jouw gedrag en dat onderwerp. Ook wordt bij elk onderwerp aangegeven naar weike 
websites je kunt surfen voor meer informeatie en/of hulp. 

Veilig vrijen Alcohol Roken Drugs Seks tegen je zin Pesten Lekker In je vel? Nare gedachten 



]e gebruikt niet alti.d (of nooit) een condoom als je met lemand naar bed gaat. Dat is onveiligi Want zonder condoom kun je een seksueel 
overdraagbare aandoening (soa) krijgen. 

Een soa kan schadetijk zijn 

3e merkt met altijd dat je een soa hebt. Maar het kan wei schadelijk zijn voor je gezondheid. Je kunt er bijvoorbeeld onvruchtbaar van 
worden. Dan kun j€ dus geen kinderen krijgen. En: een soa kun je doorgeven aan iemand anders. Zonder dat je het weet. Gebruik dus 
altijd een condoom als je vnjt. Dat beschermt tegen soa s. 

Voorkom ongewenste zwangerschap 

De pil IS een goed niddel tegen zwangerschap. Als je de pil goed gebruikt kun je niet zwanger worden. Maar de pil beschermt met tegen 
een soa of hivi Condooms doen dat wel. Gebruik dus ook altijd een condoom als je vrijt. 

Nieuwe relatie? Gebruik een condoom! 

Heb je een nieuwe relatie'' Gebruik dan de eerste dne maanden een condoom. Wil je na dne maanden zonder condoom vrijen'' En heb je 
alleen seks met je vaste (en trouwe) partner'' Doe dan allebei een soa-test. Voordat je het condoom weglaat. 

Kans op een soa? Laat je testen! 

Heb je onveilige seks gehad'' Laat je dan testen. Dat kan bij de GGD. Dat is gratis. En je hoeft je naam met te noemen. Kijk op 
www.ggd.nl voor d5 GGD die het dichcst bij jou in de buurt is. Bij de GGD krijg je ook informatie en advies over soa s, hiv/aids en veilig 
vrijen. 

Meer info 

Heb je nog vragen Dver seks, veilig vnjen of soa s'' Kijk dan eens op deze websites: 

www.seksualiteit.n 

www.sense.info 
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Figure 2 Screenshot of the 'E-Health4Uth' intervention. 
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Table 2 Cutt-off points used to select adolescents at risk 
for mental health problems (in intervention group 
'E-health4Uth + counselling') 

Well-being Cutt-off point applied 

Mental health status Score on the Strength and Difficulties 
(25 items) Questionnaire (SDQ) > 17, or a score of > 6 on 

the subscale emotionality of the SDQ [1] 



Suicidal thoughts 
(1 item) 

Suicidal attempts 
(1 item) 



Having suicidal thoughts 'occasionally' 
or more often 

Made an attempt at suicide last year 



nurses focus on specific risk areas, and refer adolescents 
to other professionals when considered necessary. 

Control group 

The control group receives care as usual, i.e. adolescents 
can check a box for a self-referral with the nurse or can 
send an e-mail to the nurse. 

Measurements 

Primary outcome measures 

The primary outcomes of the study are adolescents' 
health behaviours (alcohol, drug, smoking, safe sex) and 
mental health status. The electronic, self-administered 
questionnaire, which is used for the tailored messages in 
the two intervention groups, serves also as the baseline 
questionnaire. The questionnaires used for the health 
behaviours are constructed on the basis of several exist- 
ing instruments used by Municipal Public Health Ser- 
vices and health institutes [23] (Table 1). Mental health 
status is measured by the Strengths and Difficulties 
Questionnaire (SDQ) [25-29] and the Youth Self Report 
(YSR) [30]. The SDQ consists of 25 items describing 
positive and negative attributes of adolescents that can 
be allocated to 5 subscales of 5 items each: the emo- 
tional problems subscale, the conduct problems sub- 
scale, the hyperactivity-inattention subscale, the peer 
problems subscale, and the prosocial behaviour subscale. 
Each item is scored on a 3-point scale with O=not true, 
l=somewhat true, and 2=certainly true. A total difficul- 
ties score is calculated by summing the scores on the 
emotional problems, conduct problems, hyperactivity-in- 
attention, and peer problems subscales (range 0-40) 
[26]. The YSR comprise 119 items addressing emotional 
and behavioural problems of adolescents. Respondents 
have to indicate on 3-point scales the extent to which 
each item applies: O=not, l=sometimes, or 2=often. The 
YSR assess two broad domains of psychopathology: one 
is the externalizing which reflects behavioural problems 
and the other is internalizing which refers to emotional 
problems. In addition, problems can be grouped into 
eight narrow-band scales: anxious-depressed, with- 
drawn-depressed, somatic complaints, social problems. 



thought problems, attention problems rule-breaking be- 
haviour, and aggressive behaviour [30]. 

The health behaviours and SDQ will be measured at 
baseline and at 4-months follow-up. The YSR will be 
measured at 4-months follow-up. 

Secondary outcome measure 

The secondary outcome is health-related quality of life 
measured with the general health perceptions scale of 
the Child Health Questionnaire Child Form (CHQ- 
CF87) [31] at baseline and at 4-months follow-up. 

Socio-demographic characteristics 

Socio-demographic questions include gender, age, educa- 
tional level, country of birth, parents' country of birth, family 
structure, employment situation of the parents, and family 
affluence. Family afQuence is measured with the Family 
AfQuence Scale (FAS). The HBSC Family AfQuence Scale 
has been developed by the Health Behaviour in School- 
Aged Children: WHO Collaborative Cross -National Study 
(HBSC) to measure the socioeconomic status of ado- 
lescents in cross-national surveys [32,33]. The Health 
Behaviour in School-Aged ChUdren: WHO Collabora- 
tive Cross-National Study (HBSC) is an international 
study carried out by the HBSC International Research 
Network in collaboration with the WHO Regional Office 
for Europe. Further information on the study is available 
from www.hbsc.org. 

Process-evaluation 

After the baseline and follow-up questionnaires, the ado- 
lescents in the two intervention groups are invited to 
complete an additional questionnaire. This latter ques- 
tionnaire provides data on the evaluation of the tailored 
messages. Topics covered are: appreciation, personal 
relevance, and perceived usefulness of the information. 
Questions are asked about: reading the information, 
reading the reminders, discussing the advice with par- 
ents and peers, intention to change their behaviour, the 
length of the module, using the advice in practice, find- 
ing the information interesting, learning new things, and 
usability. In addition, adolescents are asked to rate the 
program from 1 (most-negative evaluation) to 10 (most- 
positive evaluation). Adolescents' satisfaction with con- 
sultation is assessed by 11 -items, with answers given on 
a five-point Likert scale. An extra item is measured to 
rate the consultation from 1 (most-negative evaluation) 
to 10 (most-positive evaluation). The nurses complete an 
evaluation that provides data on: the helpfulness of the 
information received from the assessment of the referred 
adolescent, estimation of the problems of the adolescent, 
action that is taken, and to which professional the ado- 
lescent is referred if considered necessary. 
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Power of the study 

Sample size was calculated taking into account the de- 
sign that includes cluster randomisation. We assume an 
intra-cluster correlation coefficient (p) of 0.1. The num- 
ber of clusters is 60, the power of the study 0.80 and 
alpha 0.05. With a participation of 85%, and a loss-to- 
follow-up of 30%, at least 1500 adolescents need to be 
invited to participate in the study to have a final sample 
of about 900 adolescents (300 in each group). Assuming 
a SD of the SDQ total score to be 5.0 [27-29], a differ- 
ence in mean of 1.6 between the adolescents in the 
intervention groups and the adolescents in the control 
group can be established under the assumptions men- 
tioned above. Assuming a SD of the YSR total score 
(range 0 - 210) to be 20.6 [30], a difference in mean of 
6.6 can be established. 

Statistical analyses 

The study assesses the effect of internet-based, tailored 
messages, and assesses the effect of these messages com- 
bined with personal counselling for adolescents at risk 
of mental health problems. An intention-to-treat analysis 
will be applied [34]. 

Multilevel regression analysis will be used to test 
group differences on the outcome measures [35]. This 
technique adjusts for the dependency between observa- 
tions of students from the same class. Linear multilevel 
analysis is applied for continuous outcome variables and 
logistic multilevel analysis for dichotomous outcome 
variables. 

Descriptive statistics are used to carry out the process 
evaluation. 

Discussion 

This paper describes the design of a randomised con- 
trolled trial on the promotion of health behaviours and 
the prevention of mental health problems in adolescents. 

The study evaluates the effect of internet-based, tai- 
lored messages CE-health4Uth'), and evaluates the effect 
of these messages combined with personal counselling 
for adolescents at risk of mental health problems ('E- 
health4Uth + counselling'). 

It is hypothesized that at 4-months follow-up adoles- 
cents in the 'E-health4Uth' group and adolescents in the 
'E-health4Uth + counselling' group will show fewer men- 
tal health problems and less risky behaviour (alcohol and 
drug use, smoking, safe sex) compared to the control 
group (care as usual'). 

Strengths of the study are the randomised controlled 
design, and providing the intervention within the daily 
practice of the Dutch Youth Health Care system. This 
will facilitate implementation of the interventions if 
found to be effective. Data will be collected in both rural 



and urban areas of the Netherlands, resulting in a higher 
level of generalisability. However, because the outcome 
measures are based on self report, misclassification 
might occur. In addition, because of including multiple- 
risk behaviours are included it is not possible to assess 
each type of behaviour in depth. 

In conclusion, this study evaluates the effect of two 
interventions on the promotion of health behaviour and 
prevention of mental health problems in adolescents. 
The results of this study will provide insight into the ef- 
fectiveness of computer-tailored messages on health 
behaviours and mental health status, and the effective- 
ness of these messages combined with personal counsel- 
ling for adolescents at risk of mental health problems. 
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